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Abstract. In this article, wc study the fluctuations of the random variable: 
Q ! Xn{p) = ^ logdet (S„e; + pIm) , (p > 0) 

where Sn = n~^'^Dn XnDj + An, as the dimensions of the matrices go to infinity 
at the same pace. Matrices X„ and An are respectively random and deterministic N X n 
matrices; matrices Z)„ and D„ are deterministic and diagonal, with respective dimensions 
NxN and nxn; matrix Xn = {Xij ) has centered, independent and identically distributed 
entries with unit variance, either real or complex. 

We prove that when centered and properly rescaled, the random variable Xn (p) satisfies 
P^ ^ a Central Limit Theorem and has a Gaussian limit. The variance of Xn(p) depends on 

P^ ■ the moment EX?, of the variables Xij and also on its fourth cumulant k = ¥.\Xij\^ — 2 — 

The main motivation comes from the field of wireless communications, where In{p) 
C^ 1 represents the mutual information of a multiple antenna radio channel. This article closely 

follows the companion article "A CLT for Information-theoretic statistics of Gram random 
matrices with a given variance profile", Ann. Appl. Probab. (2008) by Hachem et al., 
however the study of the fluctuations associated to non-centered large random matrices 
raises specific issues, which are addressed here. 

> 
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1. Introduction 

The model, the statistics, and the literature. Consider a N x n random matrix S„ = 
(5J^) which has the expression 

1 4 ~i 



. ^.', S« - -^DZXnM + An , (1.1) 



/n 



where An = (a") is a deterministic Nxn matrix, £)„ and D„ are diagonal deterministic 
matrices with nonnegative entries, with respective dimensions NxN and nxn; Xn = [Xij ) is 
a. N xn matrix with the entries Xij^s being centered, independent and identically distributed 
(i.i.d.) random variables with unit variance EjXijp = 1 and finite 16"^ moment. 

Consider the following linear statistics of the eigenvalues: 

1 1 ^ 

^n{p) = ^ logdet (I]„E: + pIn) = ]^ E log(^'' + P^ ' 

i=l 
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where /jv is the N x N identity matrix, p > is a given parameter and the A^'s are the 
eigenvalues of matrix Sn^* (E* stands for the Hermitian adjoint of Sn)- This functional, 
known as the mutual information for multiple antenna radio channels, is fundamental in 
wireless communication as it characterizes the performance of a (coherent) communication 
over a wireless Multiple- Input Multiple-Output (MIMO) channel with gain matrix I]„. When 
E„ follows the model described by (jl.ip . the deterministic matrix An accounts for the so- 
called specular component, while Z?„ and £)„ account for the correlations in certain bases at 
the receiving and emitting sides, respectively. 

Since the seminal work of Telatar |37| . the study of the mutual information X„(p) of a 
MIMO channel (and other performance indicators) in the regime where the dimensions of the 
gain matrix grow to infinity at the same pace has turned to be extremely fruitful. However, 
non-centered channel matrices have been comparatively less studied from this point of view, 
as their analysis is more difficult due to the presence of the deterministic matrix An . First 
order results can be found in Girko [HI [16]; Dozier and Silverstein [TTl [12] established 
convergence results for the spectral measure; and the systematic study of the convergence of 
In{p) for a correlated Rician channel has been undertaken by Hachem et al. in [501 [13], etc. 
The fluctuations of I„ are important as well, for the computation of the outage probability 
of a MIMO channel for instance. With the help of the replica method, Taricco [551 [3S] 
provided a closed-form expression for the asymptotic variance of T„ when the elements of 
Xn are Gaussian. 

The purpose of this article is to establish a Central Limit Theorem (CLT) for In{p) in 
the following regime 

. . N . N 

n — >■ oo and < lini inf — < lim sup — < oo , 

n n 

(simply denoted by n — > cx3 in the sequel) under mild assumptions for matrices X„, Am Dn 
and Dn- 

The contributions of this article are twofold. From a wireless communication perspective, 
the fluctuations of I„ are established, regardless of the Gaussianity of the entries and the 
CLT conjectured by Tarrico is fully proven. Also, this article concludes a series of studies 
devoted to Rician MIMO channels, initiated in [5D] where a deterministic equivalent of the 
mutual information was provided, and continued in [13] where the computation of the ergodic 
capacity was addressed and an iterative algorithm proposed. 

From a mathematical point of view, the study of the fluctuations of X„ is the first attempt 
(up to our knowledge) to establish a CLT for a linear statistics of the eigenvalues of a Gram 
non-centered matrix (so-called signal plus noise model in [TT1[T2]). It complements (but does 
not supersede) the CLT established in |5T] for a centered Gram matrix with a given variance 
profile. The fact that matrix E„ is non-centered (EI]„ = A„) raises specific issues, from a 
different nature than those addressed in close-by results [ll (U [21], etc. These issues arise 
from the presence in the computations of bilinear forms u* (3„(z) Vn where at least one of the 
vectors m„ or Vn is deterministic. Often, the deterministic vector is related to the columns 
of matrix An , and has to be dealt with in such a way that the assumption over the spectral 
norm of An is exploited. 

Another important contribution of this paper is to establish the CLT regardless of specific 
assumptions on the real or complex nature of the underlying random variables. It is in 
particular not assumed that the random variables are Gaussian, neither that whenever the 
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random variables Xij arc complex, their second moment E^f,- is zero; nor is assumed that 
the random variables are circulaiO. As we shall see, all these assumptions, if assumed, would 
have resulted in substantial simplifications. As a reward however, we obtain a variance 
expression which smoothly depends upon EX?- whose value is 1 in the real case, and zero in 
the complex case where the real and imaginary parts are not correlated. 

Interestingly, the mutual information X„ has a strong relationship with the Stieltjes trans- 
form fn{z) = -i-Trace(E„S* — zl]^)~^ of the spectral measure of I]„E* : 



i„(p)=iogp+y fi.-f,,{-w)] 



dw 



Accordingly, the study of the fluctuations of I„ is also an important step toward the study 
of general linear statistics of I]„E* 's eigenvalues which can be expressed via the Stieltjes 
transform: 

1 1 ^ If 

-Trace /i(E„E„) = ^5I^(^*) = "^ f H^)fn{z)dz , 

for some well-chosen contour C (see for instance [3]). 

Fluctuations for particular linear statistics (and general classes of linear statistics) of large 
random matrices have been widely studied: CLTs for Wigner matrices can be traced back 
to Girko [13] (see also [TT]). Results for this class of matrices have also been obtained by 
Khorunzhy et al. [57], Boutet de Monvel and Khorunzhy [7], Johansson |231, Sinai and 
Sochnikov [33] , Soshnikov [33] , Cabanal-Duvillard [S] , Guionnet [TB] , Anderson and Zeitouni 
[T], Mingo and Speicher [53], Chatterjee [5], Lytova and Pastur [5S], etc. The case of Gram 
matrices has been studied in Arharov [2], Jonsson [25], Bai and Silverstein [4], Hachem et 
al. [21], and also in [28l[29l[9]. Fluctuation results dedicated to wireless communication 
applications have been developed in the centered case {An = 0) by Debbah and Miiller 
[To] and Tulino and Verdij [S^ (based on Bai and Silverstein [4]), Hachem et al. [19] (for 
Gaussian entries) and [H] . Other fluctuation results either based on the replica method or on 
saddle-point analysis have been developed by Moustakas, Sengupta and coauthors [30l |3T] . 
and Tarrico [35l |36| . 



Presentation of the results. We first introduce the fundamental equations needed to 
express the deterministic approximation of the mutual information and the variance in the 
CLT. 

Fundamental equations, deterministic equivalents. We collect here resuls from |20j . The 
following system of equations 



Sn{z) = ^TrDn(^~z{lN+L{z)D„)+An{In + Sn{z)D„y^A. 
Liz) = ^TrDn[~z{Ir, + 6n{z)Dr,)+A*„{lN + ~Sniz)D„)~^A 



zeC-R+ 

(1.2) 



A random variable X S C is circular if the distribution of X is equal to the distribution of pX for every 
p £ C, \p\ = 1. This assumption is very often relevant in wireless communication and has an important 
consequence; it implies that all the cross moments EIXI'^X* {£ > 1) are zero. 
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admits a unique solution ((5„, ^„) in the class of Stieltjcs transforms of nonncgative measureqj 
with support in K.+ . Matrices T„(z) and T„(z) defined by 

T„(z) = (-ziIN + 6.n{z)Dr,)+Ar,{I„ + 5„Dn)-^A;^^^ 

) . . (-1 (1-3) 

T„(z) = (-z(/„ + ,5„(z)i?„)+A;(/^+<5„i^„)-iA„j 

are approximations of the resolvent Qn{z) ~ (SnS* — zIn)~'^ and the co-resolvent Qn{z) ~ 
(S* En — zIn)~^ in the sense that ( ' '> stands for almost sure convergence): 

ixr (Q„(z)-T„(z))^^^0, zeC-R+ 

which readily gives a deterministic approximation of the Stieltjes transform N^^TtQ„{z) of 
the spectral measure of E„E* in terms of r„ (and similarly for Qn and T„). Also proven in 
|22j is the convergence of bilinear forms 

<(Q„(z)-T„(z))v„^^^0, zeC-R+ (1.4) 

n— f oo 

where (u„) and {v„) are sequences of iV x 1 deterministic vectors with bounded Euclidean 
norms, which complements the picture of T„ approximating Qn- 

Matrices r„ = {tij ; 1 < i,j < N) and r„ = {tij ',1 < i,j < n) will play a fundamental 
role in the sequel and enable us to express a deterministic equivalent to EI„ (p) . Define V„ (p) 
by: 

Vn(p) = — logdet (p(/jv + (5„L»„) + A„(/„ + 6nDn)~^A*„ 

+ — log det(/„ + 6nDn) - ^Sjn , (1.5) 

where (5„ and (5„ are evaluated at z = —p. Then the difference EI„(/3) — V„{p) goes to zero 
as n — > oo. 

In order to study the fluctuations N(Xn{p) — Ki(p)) and to establish a CLT, we study 
separately the quantity iV(X„(p) — EI„(/c»)) from which the fluctuations arise and the quantity 
N{KXn{p) — Ki(p)) which yields a bias. 

The fluctuations. In every case where the fluctuations of the mutual information have been 
studied, the variance of N {In{p) — Vn{p)) always proved to take a remarkably simple closed- 
form expression (see for instance [30l |36l |38] and in a more mathematical flavour [191 121]). 
The same phenomenon again occurs for the matrix model E„ under consideration. Drop the 
subscripts N, n and let 

7 = -TrDTDT , 7 = -TrDTDT , 7 = -TrDTDT , 7 = -TrDTDT , (1.6) 
n n — n — n 

where M stands for the (elementwise) conjugate of matrix M. Let 

z9=E(Xy)2 and k = E|Xy |^ - 2 - |i?p . 



In fact, (5„ is the Stieltjcs transform of a measure with total mass equal to n ^TrD„ while 5„ is the 
Stieltjcs transform of a measure with total mass equal to n^^TrDn- 
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-TrD2TA{I + SD)-^D{I + dD)-^A*TD^' 



1 - d-TTD-^TAil + SOy'Dil + SDyA*TD-^ 
n 



P^77 



m'p'ii 



^^^E'^^^E^^ 



:2 

n 



where di = [Dnju, dj 

CLT can then be expressed as: 



[Dn\jj, and all the needed quantities are evaluated at 2 = —p. The 



TV 

7C 



(I„-EZ„)-^->AA(0,l) 



V 



where — > stands for convergence in distribution. Although complicated at first sight, vari- 
ance Qn encompasses the case of standard real random variables (i? = 1), standard complex 
random variables (^ = 0) and all the intermediate cases < ji?! < 1. Moreover, 8„ often 
takes simpler forms if the variables are Gaussian, real, etc. (see for instance Remark [ 



The bias. When the entries of X„ are complex Gaussian with independent and identically 
distributed real and imaginary parts, k = ?9 = 0, and it has already been proven in |13[ that 
EI„(p) — Vn{p) = 0{n~'^). When any of k or -d is non zero, a bias term Bn{p) 7^ appears 
in the sense that 

-^0 . 



N{mn{p)-Vn{p))-Bn{p)- 

n — ?Lxj 

We establish the existence of this bias and provide its expression in the case where A = Q. 



Outline of the article. In Section [21 we provide the main assumptions and state the 
main results of the paper: Definition of the variance 0„ and asymptotic fluctuations of 
N il„ip) - IEX„(p)) (Theorem[12|), asymptotic bias oi N {KI„{p) - K,(p)) (PropositionHS]). 
Notations, important estimates and classical results are provided in Section [3] Sections SI 
[5] and |6] are devoted to the proof of Theorem 12.21 In Section |4l the general framework of 
the proof is exposed; in Section [S] the central part of the CLT and of the identification of 
the variance are established; remaining proofs are provided in Section [6l Finally, proof of 
Proposition [23] (bias) is provided in Section [T] 
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2. The Central Limit Theorem for T,-,{p) 



2.1. Notations, assumptions and first-order results. Let i = \/"-T. As usual, M+ = 
{x e R : X > 0}. Denote by — > the convergence in probability of random variables and by 

— > the convergence in distribution of probability measures. Denote by diag(aj; 1 < i < fc) 
the k X k diagonal matrix whose diagonal entries are the a^'s. Element (i-,j) of matrix M 
will be either denoted niij or [M]ij depending on the notational context. If M is a n x n 
square matrix, diag(Af ) = diag(?7iii; 1 < i < n). Denote by M'^ the matrix transpose of M, 
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by M* its Hcrmitian adjoint, by M the (clcmcntwisc) conjugate of matrix M, by Tr(Af ) its 
trace and det(M) its determinant (if M is square). When deahng with vectors, || • || will 
refer to the Euclidean norm. In the case of matrices, || • || will refer to the spectral norm. 
We shall denote by if a generic constant that does not depend on ?i and that might change 
from a line to another. If (m„) is a sequence of real numbers, then u„ ~ 0{vn) stands for 
\un\ < ifl'i'nl where constant K does not depend on n. 

Recall that 

E„ = ^i?y2^„AV' + An , (2.1) 

denote D„ = diag{di, 1 < i < N) and £>„ = dia.g{dj, 1 < j < n). When no confusion can 
occur, we shall often drop subscripts and superscripts n for readability. Recall also that the 
asymptotic regime of interest is: 

. . N . N 

n —^ oo and < lim inf — < lim sup — < oo , 

n n 

and will be simply denoted by n ^ oo in the sequel. We can assume without loss of generality 
that there exist nonnegative real numbers i~ and i~^ such that: 

0<£"< — <^+<oo as n->oo. (2.2) 

n 

Assumption A-1. The random variables (X" ; l<i<-/V, l<j<n,n>l) are complex, 
independent and identically distributed. They satisfy 

EX{\ = 0, E|X{\|2 = 1 and E\Xl\\^^ < oo . 

Remark 2.1. (Gaussian distributions) If Xn is a standard complex or real Gaussian random 
variable, then k ~ 0. More precisely, in the complex case, Re(Xii) and Im(Xii) are inde- 
pendent real Gaussian random variables, then i? = k = 0; in the real case, then ^ = 1 while 

K = 0. 

Assumption A- 2. The family of deterministic N x n complex matrices {An,n > 1) is 
bounded for the spectral norm: 

Omax = sup II A„ II < OO . 
n>l 

Assumption A-3. The families of real deterministic N x N and n x n matrices (Dn) and 
(Dn) are diagonal with non-negative diagonal elements, and are bounded for the spectral 
norm as n — > oo ; 

dmax = sup ||L»„|| < OO and d„iax = sup \\bn\\ < OO . 

n>l n>l 



Moreover, 



dmin = inf — Tr D„ > and dmin ~ inf — Tr £)„ > 

n n n n 



Theorem 2.1 (First order results - [201 [13]). Consider the N x n matrix I]„ given by (|2.ip 
and assume that A-[TJ A-|2] and A-[3] hold true. Then, the system (jl.2p admits a unique 
solution {5n,Sn) in the class of Stieltjes transforms of nonnegative measures. Moreover, 

-Tr (Q„(z) - T„{z)) -^^^ and -' 
n n-i-oo n 



-Tr (Q„(z)-r„(z)) -^^^0 and -Tr fg„(z) - f„(z)) ^^ for any z e C - ] 

fl n— ^oo n \ / n— J-oo 
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2.2. The Central Limit Theorem. In this section, wc state the CLT then provide the 
asymptotic bias in some particular cases. 

Theorem 2.2 (The CLT). Consider the N x n matrix E„ given by (|2.ip and assume that 
A-[TJ A-I2] and A-|3] hold true. Recall the definitions of S and S given by p.2p . T andT given 
by p.3p . 7, 7, 7 and^ given by p.6p . Let p > 0. All the considered quantities are evaluated 
at z = —p. Define A„ and A,j as 

A„ = (l--TT:D^TA{I + 5D)-'^bA*TD^-\ - ^^77 



anrf 

1 - - ^ 

1 - t?-TrD^ryl(/ + (5i))"^i)A*ri:)^ 
n 



Then the real numbers 



Wp'ii 



2 N n 

e„ = - log A„ - log A„ ^^^Y. '^^^^i E ^'^1 (2.3) 

are well-defined and satisfy: 

< liminfOn < limsup8„ < 00 (2.4) 

» n 

as n —)■ 00. Lei 

2:n(p) = ^iogdet(s„s; + p/jv) , 



i/ien the following convergence holds true: 



N n 

(I„(p)-EI„(p))-^->AA(0,l) 



ve. 

Remark 2.2. (Simpler forms for the variance) We consider here special cases where the 
variance 0„ takes a simpler form. 

(1) The standard complex Gaussian case. Assume that the X^-'s are standard complex 
Gaussian random variables, i.e. that both the real and imaginary parts of Xy are 
independent real Gaussian random variables, each with variance 1/2. In this case, 
'd = K = and 0„ is equal to — logA„, and we in particular recover the variance 
formula given in |36| . 

(2) The standard real case. Assume that the X^-'s are standard real random variables, 
assume also that A has real entries. Then A„ and A„ are equal. 

(3) The 'signal plus noise' model. In this case, Dn = In and £)„ = /„, which already 
yields simplifications in the variance expression. In the case where ?? = 0, the variance 
is: 

e„ = - log ((1 - n-\l + Sr- TrTAA*Tf - ^^7) + ^ E ^^' E ^M. ' 

i j 

As one may easily check, the first term of the variance only depends upon the 
spectrum of AA* . The second term however also depends on the eigenvectors of 
A A* (see for instance [26]). 

A full study of the asymptotic bias turns out to be extremely involved and would have 
substantially increased the volume of this paper. In the following proposition, we restrict 
our study to two important particular cases: 
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Proposition 2.3 (The bias - particular cases). Assume that the setting of Theorem 
holds true. 

(i) If the random variables {X",;i, j,n) are complex with ^c{X'^A and Im(X") indepen- 
dent, both with distribution M{Q, 1/2), then: 

iV(EX„(p)-K(p))=o(^^ 
(ii) If An = 0, let the quantities 7 and 7 be evaluated at z ^ —p and consider 

Bn = -^p'll + \ log(l - I^IV'77). (2.5) 

Then 

N (EI„(p) - V„{p)) - Bn > 0. 

n— >-oo 

Remark 2.3. Observe tliat T{z) = [~z{I + 6{z)D)]-^ and f{z) = [-~z{I + 5{z)D)]-^ when 
A = 0. It is interesting to notice that i3„ coincides in that case with — 0.5 x the sum of the 
two last terms at the right hand side (r.h.s.) of (j2.3|) . 

Proof of Proposition [23] is deferred to Section [7l 



3. Notations and classical results 

3.1. Further notations. We denote by Y the N x n matrix n^^/^D^^^XD^/^; by (77^), 
(aj) and (i/j) the columns of matrices S, A and Y. Denote by T,j, Aj, and Yj the matrices 
S, A, and Y where column j has been removed. The associated resolvent is Qj{z) = 
(SjS* - zIn)~^. We shah often write Q, Qj, T for Q(z), Qj(z), T(z), etc. We denote by 
Dj matrix D where row and column j have been removed. We also denote by Ai-j and Si^j 
the N X j matrices Ai-j = [ai, • • • , aj] and 'Si-j = [771, •• • , rjj]. Denote by Ej the conditional 
expectation with respect to the ct- field Tj generated by the vectors {yi, 1 < i < j)- By 
convention, Eq = E. 

We introduce here intermediate quantities of constant use in the rest of the paper. For 
1 < j < ri, let: 

^j(z) = — -; r , 

^l + a*Q,{z)a, + ^Ti-DQ,{z)j 



e^.(z) = v;Qj{^)Vj - (^ TrDQ,{z) + a*Q,{z)a,) 

= y]Qj {z)y] ^ Tr DQj (z) + a*Qj (z)yj + y*Qj {z)aj 



(3.1) 



3.2. Important identities. Recall the following classical identity for the inverse of a per- 
turbed matrix (see [231 Section 0.7.4]): 

[A + XRYY^ = A-^ - A-^X {R-^ + YA-^X)'^ YA'^ . (3.2) 
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Identities involving the resolvents. The following identity expresses the diagonal elements 
qjj{z) = [Q{z)]jj of the co-resolvent; the two following ones are obtained from p.2p . 

9jj(^) = -77- — *n t \ \ ' (^-^^ 



Q{z)^Qj{z) 



_ QjizHv]Qjiz) 



= Qj{z) + zq,j{z)Q,{z)T^jri*Q,{z) (3.4) 

Q{z)rijri*Q{z) 



1 



'^"^^^''^'^^^i-.^Qiz),, 



(3.6) 



Notice that 



9ij(2) = hi^) + zqjj{z)bj{z)ej{z) . (3.7) 

and that < bj{—p),qjj{—p) < p^^. These facts will be repeatedly used in the remainder. 
A useful consequence of (|3.4[) is: 

Identities involving the deterministic equivalents T and T. Define the N x N matrix Tj(z) 



as 



Tj{z) = (-z(/Ar + ~5{z)D) + A,{In-i + S{z)D,)-'A*) ' , (3.9) 

where S and S are defined in (jl.2p . Notice that matrix 7j is not obtained in general by 
solving the analogue of system (|1.3p where A is replaced with Aj and when D is truncated 
accordingly. This matrix naturally pops up when expressing the diagonal elements tjj of T. 
Indeed, we obtain (see Appendix lA.ip : 

i,,{z) = — — ^— — . (3.10) 

z fl + a*Tj{z)aj + djS{z) j 

Let 6 be a given N x 1 vector. The following identity is also shown in Appendix lA.il 

- zi,,{z)a;%{z)b = f'^jf^ . (3.11) 

1 + ded[z) 

Thanks to (|3.2p . we also have 

f{z) = -z-\l + 5{z)b)'^ + z^\l + 6{z)by^A*T{z)A{I + 5{z)b)-^. (3.12) 

3.3. Important estimates. We gather in this section matrix estimates which will be of 
constant use in the sequel. In all the remainder, z will belong to the open negative real axis, 
and will be fixed to z = —p until Section [71 

Let A and B be two square matrices. Then 



\Ti{AB)\ < y/TiiAA*)y/TiiBB*) (3.13) 
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When B is Hcrmitian non negative, then a consequence of Von Neumann's trace theorem is 

\Tt{AB)\ < \\A\\TtB. (3.14) 

The fohowing lemma gives an estimate for a rank-one perturbation of the resolvent ( \21\ 
Lemma 6.3] and [311 Lemma 2.6]): 

Lemma 3.1. The resolvents Q and the perturbed resolvent Qj satisfy for z ~ —p.- 

I^ll 



\Ti-A{Q-Q,)\< 



for any N x N matrix A. 



The following results describe the asymptotic behaviour of quadratic forms based on the 
resolvent. 

Lemma 3.2 (Bai and Silverstein, Lemma 2.7 in [3]). Let x ~ (xi, • • • , x„) be a nx 1 vector 
where the Xi are centered i.i.d. complex random variables with unit variance. Let M be a 
n X n deterministic complex matrix. Then for any p > 2, there exists a constant Kp for 
which 

E|a;*A/a; - Tr Af |p < Kp ((E|xi|4 TrMAf*)^^^ + E\xi\^p Tr(Af A'/*)^/^ 

Remark 3.1. There are some important consequences of the previous lemma. Let (Af„) be a 
sequence of n x n deterministic matrices with bounded spectral norm and (a;„) be a sequence 
of random vectors as in the statement of Lemma [221 Then for any p E [2; 8], 

<Af„a;„ TrA/„ " „, ,„\ . K 



E|^.l^j<;^ (3-15) 

where Cj is given by p.ip (the estimate IE|ej|P = 0{n^P'^) is proven in Appendix I A. 2^ . 

Remark 3.2. By replacing E|a;i|'' with max^ E|a;i|^ and Ejxip^ with maxiE|a;,;pP, Lemma [3?^ 
can be extended to the case where elements of vector x are independent but not necessarily 
identically distributed [S] Lemma B.26]. Accordingly, the results of this paper remain true 
when the Xij are independent but not necessarily identically distributed, provided EjXijp = 
1, EXfj = I?, and E|X,j|4 - 2 - \-d\^ = k for all i,j, and sup^maxi,^ E|Xij|i6 < cx). 



The following theorem is proven is Appendix lA. 31 

Theorem 3.3. Assume that the setting of Theorem \2.2\ holds true. Let (un) and (u„) be 
two sequences of deterministic complex N x 1 vectors bounded in the Euclidean norm: 

supmax(||M„||, ||u„j|) < oo, 

n>l 

and let {Un) be a sequence of deterministic N x N matrices with bounded spectral norms: 

sup||f7„|| < CX). 

n>l 

Then, 

(1) There exists a constant K for which 

n 

^E|<Q,a,f < K. 
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(2) The following holds true: 



11 



Tr U{T - EQ) 



< 



K 



(3) For every p £ [1,2], there exists a constant Kp such that: 

nP 

(4) For every p g [1,2], there exists a constant Kp such that: 

(5) There exists a constant K such that 

E|Trt/(Q-EQ)|^ < K. 



The following results stem from Lemma 13.21 and Tlieorem l3.3l and will be of constant use 
in the sequel. Recalling p.7p and p.lSp along with the bounds on qjj and bj, we have for 

any p € [2, 8] 

p K 



^jj-bj 



< 



nP/^' 



(3.16) 



Of course, the counterpart of Theorem 13.31 for the co-resolvent Q and matrix T holds true. 
In particular, taking the vectors u„ and v„ as the jth canonical vector of C" yields the 
following estimate for any p G [2, 4]: 

K 



^m-tj]] < 



nP/2' 



(3.17) 



The following two lemmas, proven in Appendices IA.4I and IA.5[ provide some important 
bounds: 



Lemma 3.4. Assume that the setting of Theorem \2.2\ holds true. Then, the following quan- 
tities satisfy: 

im^ <Sn< ^"^'^""^ ^ii^ ^ X ^ d„ 



P+dmax'^max+aj^ 



d„ 



(p+d„axd„ax + a^^^)2 



< -TvDT"^ < ^^'^ 



P+^+d„,axd„,ax- 



<(5„< 



-at 



n 



e+ (p+d„,axd„ax+aj,ax)^ 

N 



<7n< 



■^ ' (p+£+d„,axd„ax+a^,,) = 



e+dl 



1 

n 



< - Tr DT^ < ^^ 



„2 , 



1 



^+(p+d„axd„ax + a^^^)2 " j^ Z^ « ' 

i=l 



2 ^ ^+d^, 
— — 77^ 



(p+^+d„axd„,ax+aJ 

d-l,„ 



<7n< 



1 



(p+£+d„axd„ax + a?„,,)^ - n^"'^ " ~ ~P^ 



^<-T.^Fr< 



Lemma 3.5. Assume that the setting of Theorem \2.S\ holds true. Then 
sup -TrD^/^TA{I + 6D)-^DA*TDi < 1. 



A„ > A Tr DT^ -^ Tr DT^ 



Moreover, the sequence (A„) as defined in Theorem \E.2\ satisfies 

nS nS 

lim inf A„ > . 
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3.4. Other important results. The main result we shall rely on to establish the Central 
Limit Theorem is the following CLT for martingales: 

Theorem 3.6 (CLT for martingales, Th. 35.12 in [6]). Let 7i , 72 i • ■ • :7ii be a martin- 
gale difference sequence with respect to the increasing filtration J^}" , . . . , Jvi" . Assume that 
there exists a sequence of real positive numbers T^ such that 

wElE.-i7r'-J->l- (3-18) 

Assume further that the Lyapounov condition (|B1 Section 27] j holds true: 



1 I 



2+(5 

^0 . 



Then T^^ X^i^i ij converges in distribution to Af{0, 1). 

Remark 3.3. Note that if moreover liminf„ T'^ > 0, it is sufficient to prove: 



^E,_i7f''-T^-^0, (3.19) 

instead of ((XT5)) . 

We now state a covariance identity (the proof of which is straightforward and therefore 
omitted) for quadratic forms based on non-centered vectors. This identity explains to some 
extent the various terms obtained in the variance. 

Let X = (xi, • • • , xn)"^ be a A'^ X 1 vector where the Xi are centered i.i.d. complex random 
variables with unit variance. Let y = N~^^^D-^/^x where D is a, N x N diagonal nonnegative 
deterministic matrix. Let Af = (rriij ) and P = [pij ) he N x N deterministic complex matrices 
and let M be a A^ X 1 deterministic vector. 



If M is an iV X A^ matrix, vdiag(M) stands for the A^ x 1 vector [Mn, • • • ,M 



]T 



NN\ 

Denote by T(M) the random variable: 

T{M) = iy + urM{y + u) . 
Then ET(il/) = -^ Tr DM + u*Mu and the covariance between T(M) and T(P) is: 
E [(T(A/) - ET(A/)) (T(P) - ET(P))] 

= -^ TiiMDPD) + ^ (u*MDPu + ti'PDMu) 

|Efa;?lP , ^ , Eb?l , ^ Ete?! ^^ ^ 

+ ' [}," Tr(MDP^D) + -y^u*PDM^u + -\^u^M^DPu 

N'' N N 






(u*PD^/'^vdieigiM) + it*ML>3/2vdiag(P) 



IE[|2^i l'5;i] ^^diag(P)^7^3/2^^^ ^ Ydia.g{MfD^/^Pu 



Ar3/2 

N 
+ T72 E 4"^«Pj» , (3.20) 



7V2 

1=1 



where k = E|a;i|4 - 2 - [Exfp. 
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Remark 3.4. Identity (|3.20p is the cornerstone for the proof of the CLT; it is the counterpart 
of Identity (1.15) in [J. The complexity of Identity p.20p with respect to gl Identity (1.15)] 
hes in 8 extra terms and stems from two elements: 

(1) The fact that matrix E is non-centered. 

(2) The fact that the random variables X^j's are either real and complex with no par- 
ticular assumption on their second moment (in particular, ^Xf; can be non zero in 
the complex case). 

It is this identity which induces to a large extent all the computations in the present article. 



4. Proof of Theorem 12.21 (part I) 
Decomposition ofI„ ^IEI„, Cum,ulant and cross-moments terms in the variance 

4.1. Decomposition of I„ — EI„ as a sum of martingale differences. Denote by 

_ ^^;Qj^.-(^TrJJQ,+a;Q,a, 



l + ^TrDQj+a*Qjaj- 
With this notation at hand, the decomposition of I„ — EI„ as 

n 

In - EI„ = ^(Ej - Ej_i ) log(l + r,) (4.1) 

i=i 

follows verbatim from [21] Section 6.2]. Moreover, it is a matter of bookkeeping to establish 
the following (cf. EH Section 6.4]): 

n n 

^E,_i ((E, - E,_i) log(l + r,))' - 5]E,-i(E,r,)2 -^-> . (4.2) 

j=i j=i 

Hence, the details are omitted. In view of Theorem [3^ Eq. (|XTg)) . (|i?T|) and (|i?^ . the CLT 
will be established if one proves the following 3 results: 

(1) (Lyapounov condition) 

n 

36 >0, yE|E,r,f+'^ >0, 

(2) (Martingale increments and variance) 

n 

yE,_i(Ejrjf-e„-^o. 

(3) (estimates over the variance) 

< liminf 0,1 < limsup0,i < oo 

" n 

It is straightforward (and hence omitted) to verify Lyapounov condition. The convergence 
toward the variance is the cornerstone of the proof of the CLT: The rest of this section 
together with much of Section [S] are devoted to establish it. The estimates over the variance 
Qn, also central to apply Theorem 13.61 are established in Section [ 
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Notice that Ej_i{EjTjy = E,j_i(Ejpbjej)^. Wc prove hereafter that 



n 



2 -P 



^E,_i(E,p5,e,)2 -J^p'Pn^j-ii^j^jf ~ 



^0 . 



(4.3) 



j=i 



j=i 



The inequahty E|6j — tjj\'^ < 2E\bj — qjj\'^ + 2E|(7jj — ijj\'^ in conjunction with Estimates 
((3l6)) and ((37T71) yield E\bj - tj-jp = 0{n-^). Moreover, 



E E,_i(E,p6,e,)' - E,_i(pt,,E,e,)' 



= E 



<E 



Ej {pbj - ptjj )ej Ej {pbj + ptjj)ej 



jPbjej] - (EjPtjjej) 
<E 



{pbj - ptjj)ej [Ej{pbj + ptjj)ej^ 



using Cauchy-Schwarz inequality and (|3.15l) . This implies (|4.3p . Let i; = E(|X^]^|Xii). Using 
Identity (|3.20p . we develop the quantity Ej_i(Ejej)^: 



N 



^p2i^^.E,_i(E,e,) 

n 
, n / 



4 x^ 2^~3/2r2 „ / a*(E,Q,)Z?3/2vdiag(E,Q, 



j=i 



1 " /d^ \ 

-E^'*l \-'^m,Qj)D{E,Q,)D + 2d,a*{E,Q,)D{E,Q,)aj 

1 " / J2 _ 

- E^'*l I'^l'^ Tr(E,Q,)I?(E,Q,)i? + 2Re [M,a*{E,Q,)D{E,Q,)-c 



j=i 



A 



E ^ij + E ^2j + E ^3j + E ^4j 

i=l J=l i=l j=l 



4.2. Key lemmas for the identification of the variance. The remainder of the proof 
of Theorem 12.21 is devoted to find deterministic equivalents for the terms Yll=i Xij for i = 
1,2,3,4. 

Lemma 4.1. Assume that the setting of Theorem \2.S\ holds true, then: 

2 N n 



J = l 



2 ,2 T2r2 T 



Exi.--^EE'^'^'^^>« 



^0 



i=l 3 = 1 
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Proof. Write 

N N 

i=l i=\ 

N ^ N 



i=l 



The term \ei,j\ = n"i|Ej[Tr D^ diag(EjQj)((5j - 0)]| is of order 0{n-'^) thanks to Lemma 
13.11 Moreover, E|e2.j| — 0{n~^/^) by the analogue of (|3.17p for the diagonal elements of the 
resolvent. Hence, 



n 2 ^ / 1 -^ 



^0 



i=i 



j=i 



Iterating the same arguments, we can replace the remaining term Ej[(5j]ii by ta to obtain 
the desired result. D 

Lemma 4.2. Assume that the setting of Theorem \2.Si holds true. Then: 



Ex2.-5->o 

J = l 



Proof We have 



E 



E^2j 



< ^^Ea*(E,Q,)i^3/2vdiagW,-) 



^ -El 



/n 



n 



j=i 



'■j^j 



— > E 



/,vdiag(r) 

a*(E,Q,)^'/' 



-Ve 

91 ^ ' 



a*(EjQ,)Z?3/2 



vdiag(Q - T) 



j=i 



vdiag(gj - Q) 



(4.4) 



The first term satisfies 



E^ 



QjD^'^ 



vdiag(r) 



"j^j 



<v^(EiE 



a*QjD^^ 



2vdiag(r) 



1/2 



As ||n-i/2D3/2vdiag(T)|| = ("-i ^^^ dfifji/^ < iiT, Theorem [33 (P) can be applied, and 
the first term at the r.h.s. of (|4.4p is of order 77,^ ^/^^ ^g j^qw deal with the second term at 
the r.h.s. 



E 



a;(E,g,)7^3/2 



vdiag(g - T) 



ypn 



< KE 



vdiag(Q - T) 



y/n 
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by p.l7p . Wc now consider the third term. Since \\a*{¥.jQj)D^^'^\\ is uniformly bounded, 

K 



i=i 



by Lemma 13.1 



-1j^J2^\tt (diag(a*(E,Q,)^'/')(Qj - Q) 



j=i 



< 



n 



Lemma 4.3. Assume that the setting of Theorem \2.2\ holds true, then: 

2 



X1^3i+log ( n - -Tr D^ T A{I + SD)-^D A* TDi 



p'77 -^ 0. 



Lemma 4.4. Assum,e that the setting of Theorem \2.2\ holds true, then: 

2 ^ 



Y^ Xij + log 



1 - i9-Tr D^TA{I + SDy^DA*TD-^ 



I^IV77 -^-^0 



The core of the paper is devoted to the proof of Lemma 14.31 This proof is provided in 
Section[5l The proof of Lemma IT4l foHows the same canvas with minor differences. Elements 
of this proof are given in Section |6l 



5. Proof of Theorem 12.21 (part II) 



This section is devoted to the proof of Lemma 14.31 We begin with the following lemma 
which implies that Y^"^i X3j can be replaced by its expectation. 

Lemma 5.1. For any N x I vector a with bounded Euclidean norm, we have, 

ma.xva.i{a*{EjQ)D{EjQ)a) = 0{n^^) and maxvai {Tr {E.jQ)D{E.jQ)D) = 0(1). 
j 

Proof of Lemma EH] is postponed to Appendix lB.il Observe that: 



E ^3^ = ^ E P^^33 ( f Tr(E,0,)I?(E,Q,)i^ + 2d,a*{E,Q,)D{E,Q,)a, ) 

^-^P^^j -^Tv{EjQ)D{EjQ)D + 2dja*{EjQj)D{EjQj)a.j +0{n-^) 



j=i 



due to Lemma 13.1 1 Consider the following notations: 

^. = -TrEf(E,Q)L>(E,,-g)L>] = iTrEf(E,0)i:»Qi:»] , 
n n 

Ckj = E{al{EjQ)D{E,Q)ak]=E[al{E,Q)DQak] , 
Okj = E{aUE,Qk)D{EjQk)ak]=E[al{EjQk)DQkak] , 

1 ^ 
(Pj = - ^ p^dktik^k] ■ 

fc=l 
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Thanks to Lemma 15.11 we only need to show that 

-y^(p''EJUj+2p''djE,9jj) + logA„ ^0. (5.1) 

J=l 

There are structural links between the various quantities fAj , Cfcj : ^fcj s-nd <^j . The idea be- 
hind the proof is to establish the equations between these quantities. Solving these equations 

will yield exphcit expressions which will enable to identiiy ^ 'YTi=\ Kf^'^h^j'^i + '^P^^i'^j^n ) 
as the deterministic quantity — log A„ up to a vanishing error term. 

Proof of (|5.ip is broken down into four steps. In the first step, we establish an equation 
between Cfcj, "^j and ipj (up to OirT^I"^)): Eq. (|5.7p . In the second step, we establish an 
equation between -i/jj and ipy. Eq. (j5.1ip . In the third step, we establish an equation between 
Cfcj, V'j and dkf Eq. (|5.12p . Gathering these results, we obtain a 2 x 2 linear system (|5.15p 
whose solutions are ■i/'j and ipj. In the fourth step, we solve this system and finally establish 

(EH)- 



5.1. Step 1: Expression of Cfcj = E[a^(EjQ)L>gafe]. Writing 

g = T + T{T-^ - Q-^)Q = T + T (pSD + A{I + 5b)-^A* - EE* ) Q , (5.2) 

we have: 

DQau 



Cfcj=E al'&j T + t(p6D + A{I + 6b)-^A* -T.T.*\ 
= ¥.[alTDQaK] + p6E[alTD{EjQ)DQak] 



+ ¥.[alTA{I + SD)-^A*{EjQ)DQak] - E[alT{E^Y.Y.*Q)DQak] , (5.3) 

= alTDTak + pSE[alTD{EjQ)DQak] +X + Z + e , (5.4) 

where X and Z are the last two terms at the r.h.s. of (|5.3p and where |e| ~ 0{n~^^^) by 
Theorem 13. 3K (3|). Beginning with X, we have 

^ 1 + Sde 

_ Y^ E[alTaia}(EjQe)DQak] _ y^ E[piualTaeaf(EjQiriir]^Qt)DQak] 
~ hi 1 + 5d, ^ 1 + 5d, ^' ' 

EE[alTatal{EjQi)DQak] •^E[piualTaeal(EjQiair]^Qi)DQak] 
,^1 l + 5de ^ 1 + Sd, 

EE[alTaia}{EjQe)DQak] •^E[ptua*kTagalTtat{Ejifi^Qe)DQak] , 
,^1 i + Mi fr[ i + 5d, 

= Ai + A2 + £1 + £2 + £3 , 
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where 

EE[alTai{Ej {pqu - piu)alQir]ir]'^Qi)DQak] ,^ ^. 
r^j ' ^^■^> 



n 

^3 - -E 





\ + 6di. 


E[ptu 


alTaia*,{EjQmV*iQi)DQak] 




1 + Sdi 


E[ptu 


alTae{Ejae{Qe - Ti)aeri;Qe)DQak] 



l^-y 1 + ^di 



Using p.3p and p.8p . e\ can be written as: 



£1 =E 



Ej <TA diag(e«) (/ + (5i?)-^I]*0 i^Qafe 



whereof = p{qu—tu){l+ri'^Qi'i]i)agQiri£. Recalling that |jE*(5j| is bounded, we obtain |ei| < 
KE\\alTAdiag{ie)\\ < ^(ELi \[a*kTA]e\^E^fy/^ < K/^ by (IXT71) and the boundedness 
of E|Xii|^^ (Assumption All]). We show similarly that £2 and £3 (with the help of Theorem 
[331- (|4))) are of order ©(n-^/^). We now develop X2 as: 

V _ _\^ ^[P^'U a-lTae a}Tiai al{EjQii)DQak\ _ >A E[piu alTai a^Tiai y'^(EjQi)DQak] 



f^i 1 + Sdi ^ 1 + Sdi 



= Ui + U2 



The term C/2 can be expressed as: 

]E[p^t«g« alTae a^Teae yfiEjQe)DQiT]i rigQeak] 



t/2=E 



^^ 1 + <5dc 



_ ■\p ^[p-tji alTaj alTeae y}{EjQi)DQi>iji V^Qea-k] .^, _i/2x 

^ it 1 + -^^^^ 

Write 77^?7| = aia^ + aiy^ + yeyf + yta'^. The term in aia'^ is zero. Turning to the term in 
o-iVi, '^^ have E\y1(EjQe)DQ(aiyiQiak\ — ©(n"^), hence 

'\E{pH\alTata\rtatyl{^,Qt)DQiaiylQiak\\ ^K^.,^ , ^ iiT 
t[ l + 5di ~ ''t[ V^ 

Moreover, 

Y^ \E[pH'ff^ alTae a^Teae y}{EjQi)DQiyi y}Qtak\ \ 



^^1 1 + 5di 



^ |e ^pHj^alTaialTiai (yl{EjQi)DQiyi - J^n"! TrD{EjQt)DQ^ y^Qiau 



j 



1 + Sdi 



< :^^|al.ra,| = 0(n-V2). 



n 

(.=1 
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The term in j/fa| is written as 

y^ Wyp^ili alTai alTiaj yg{EjQi)DQiye a^QiUk] _ . sr^ E[p'^dii'j^ alTai alTeae agQeak] 
tt 1 + Sdi " '^ 1 + Sd, 

where e = 0{n^^) by Lemmas 15. II and 13. II The remaining term in the r.h.s. can be handled 
by the foUowing lemma which is proven in appendix IB. 21 

Lemma 5.2. Let (u) ~ {un)neN be a sequence of vectors with bounded Euclidean norms. 
Let {ae)i<e<n = {ae.n)i<e<n be an array of bounded real numbers. Then: 

ai u*Tai E [atQm] = V / + 0{n-^'^) . 

i^i i^i ptee{i + ded) 

Applying this lemma with u ~ a^ and a^ ~ p'^tf^df{l + dt)~^ aiTtag , we obtain 

TT I sr^ pdeteealTaea'tTeata'tTak , „, -i/2\ 
U-? = 4'; > ^ h 0(n ' ). 

'tt (i + sdey 

Gathering these results, and using the identity (1 — ptuo.'^Tiai) = ptu{l + dgS) (see p.lOp 'l. 
we obtain 

X = J2 ptu alTa, n^i^mDQauHi', E P"^''" °^^°^ f I^' "'*^"' +0{n~"')- (5.6) 
We now turn to the term Z in (15.41). 



Z = -Y,nalT{KjpqumrilQi)DQak] = - ^ pt„EKr(E,77,?7; Q,)7^Qafc] + e 



e=i 1=1 

where 



e^Y. "^["fe^ (^J '^(^« - iu)mViQi) DQ 



flfej 



satisfies e = 0{n ^/^) (same arguments as for ei in (|5.5p ). Writing rier]f = Oio} + yiy^ + 
1*1 , we obtain: 



Z = - E piu alTai E[a* {EjQe)DQak] 
i=i 

I J ^ n 

-\YpiuE[alTyiyl{EjQt)DQak\ + - ^ piudfE[alTD{EjQt)DQ 



n 
=1 e=j+i 



J 



- J2 Ptu alTae E[y;{E,Qe)DQak] - ^ piu E[alTye a}iE,Qe)DQak] + 0{n-^l'') 
e=i 1=1 

Zi+Z2 + Z:^ + Zi + 0{n-^/^). 



20 HACHEM ET AL. 



The term Zx cancels with the first term in the decomposition of X (first term at the r.h.s. of 
(j5.6|) ). The term Z2 can be written as: 

i 1 " 

j 



'^p'^Pu E[afeTj/£ Hf {Ej Qe)DQir]i rjl QiUk] + e 



A 



Wi+W2 + e , 

where e follows from the substitution of pqu with pifg and satisfies e = 0{n^^^^) as in ([5 
Consider first Wi: 

(l ^ 1 " 

W^i = - -Y,piudi^[alTD{K,Qf,)DQiak] + - ^ ptum[alTD{EjQf,)DQak] 

Write: 

{E.jQt)DQt - iEjQ)DQ = {E,Qe)D{Qe - Q) + {E,Qe - E,Q)DQ . 
Using dSl]) and (|3J|) . 

i ^pt«d, \E[alTD{E,Qe)D{Qe - Q)ak]\ < ^ ^ (E|(l + V*iQm)\''y^^ (Elr^^Qafc^)'/' 
e=i e=i 

and the same arguments apply to the term {EjQi — EjQ)DQ. Hence, 

Wi = -p~5E[alTD{EjQ)DQak\+0{n-^/^). 

Turning to W2, we have: 

j 
y^ p^tft ^[o*kTyi yt {EjQi)DQiyi a^Qeak] 

j T 

= Y, p''Pu^[alTyt {yl{EjQi)DQm ~ - Tr D{E,Q,)DQiyiQ,au 

whose modulus is of order 0(71"^/^). The term 

j 
y^^p'^ijfE[alTyeyfiEjQi)DQiaiy^Qiak] 
e=i 

can be handled similarly. 

The term 

3 -, 3 

J2 p'Pu^alTyiyl{E,Qi)DQtaialQiak] = - ^ p'PudtE[alTD{EjQi)DQtatalQtak_ 



n 
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is bounded by Kn~^/^. Finally, 

j 

e=i 



n 



where (a) follows by standard arguments as those already developed. 
The term Z3 satisfies 

3 

(=\ 

Writing r\tvJl — yiy*g + a£j/| + atd\ + yta\ and relying arguments as those already developed, 
one can check that the only non- negligible contribution stems from the term containing yiia\. 
Hence, 

i 

= ^y piudtalTajalTau ^.-1/2) 

by Lemma (|5.2p . Similarly, 

Z4 = ^p2^1,E[4Ty,aKEj0£)i?gf??fr/;Qfafc]+O(7i-i/2) , 
£=1 

1 ^ 
= alTDTak- Y, p'ddu^[a}{EjQe)DQ,ae] + 0{n-^/^) , 

= alTDTak^j + 0{n-^^^) . 

Gathering these results, we obtain 

n 
Z = -Y,pieealTaeE[4{EjQe)DQak]- pSE[alTD{EjQ)DQak] 
i=i 

+ ^, alTDTa, i ± p^P,,d^, + ^, ± pi^^dealTaeaJTa, ^ ^,^^^^^ ^^ ^ ^^^_,/,^^ 
" £=1 e=i ^ + '^^'^ 

Plugging this and Eq. (|5.6p into (|5.4p . and noticing that piu{aiTiag{l + d£(5)~^ + 1) = 
(1 + dfiJ)^^, we obtain: 



+ alTDTak 'f^ + ©(n-^/^) , (57) 
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5.2. Step 2: Expression of i'j = n^^ TtE[{EjQ)DQD]. Using Identity (|0|) . wc obtain: 



V-j = - TrE[ri:»g7:>] + — TrE[ri:»(EjQ)i:>gD] 

+ -TrE[TA{I + SD)-^A*{EjQ)DQD] - -Ti-E[T{EjJ:j:*Q)DQD] , (5.8) 

= - Tr DTDT + — i:-i:E[TD{E,,Q)DQD] +X + Z + £ , (5.9) 

n n 



where X and Z are the last two terms of the r.h.s. of (|5.8p . and where e = 0{n~^) by 
Theorem 13 . 3[ ([2|) . Due to the presence of the multiplying factor n~^, the treatment of X and 
Z is simpler here than the treatment of their analogues for (^kj ■ We skip hereafter the details 
related to the bounds over the e's. The term X satisfies 



1 ,A E[a}{EjQ)DQDTae] 
~n^ 1 + Sdi ' 

_l^ E[a}{EjQe)DQDTae] 1 ^ E[piu{EjalQirjir]*Qt,)DQDTat] 

_ 1 ^ E[a*{EjQe)DQDTai,] 1 >^ E[pt« a^Tiai a*f{EjQe)DQDTai] 
" n^ 1 + 5de "^ i+Sde 



J 



j_\p E[ptu alTeae yf{EjQi)DQDTai] 
n^ 1 + Sde 



■£ , 



where max(|£|, |e'|) = 0{n ^/^). As 1 — piua^Tiae ~ piu(l + diS), 



/7 1 '^ « 1 1 + 5dp 



n 

e=i 1=1 



1 ± E[pk, al (E, g.)i^gi^ra.] + tLJ2 ^^ -*^^-^ "J^^"^ + 0(,-i/2) , (5.10) 

'^fci " £=1 (1 + ddf)-^ 
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where p. lip is used to obtain the last equation. The term Z can be expressed as: 

n 

i=\ 
1 " 

£=1 

i^E[pf«y;(E,gf)7^Qi?ry^] + ^ J2 ^TTE[pdiiuTD{EjQe)DQD] 
1=1 i=j+i 

-.J , J" 

- -J2^[piuyK^iQi)DQDTae] - - ^E[pt«a|(EjQ,)Z?Qi?ry,] + ©(n-^/^) ^ 
e=i 1=1 

= Zi+Z2 + Zz + Zi + 0{n-^l'^). 

The term Z\ cancels with the first term in the r.h.s. of X's decomposition (jS.lOp . The terms 
Z2, ^3 and Z4 satisfy: 



Z2 = -—TxW(rB{^.jQ)DQB\ + -Y,^p''PuyU'^jQi)DQemV*eQeDTye] + 0{n-^^^) 

£=1 

/^A 1 1 ^ 

= -— TrEfri:)(E,0)i:>gD] + V',- - Tr DTDT- Vp^J^E, + 0(^-1/2) , 

1 ^ 
Z^^-Y E[p^P^^y}(EjQe)DQir,e vlQiDTae] + 0{n-^l'') 



n 
1=1 

j 

ijj-Y pd,tu "'*^^-^°' + 0(7i-i/2) (see ThUKgD and (IHUl) ). 
ri ^ 1 + df (5 



1 -^ 
Zi = -yE[p''Pua*e(EjQe)DQemvlQiDTye] + 0{n-^l^) 
n ^ — ' 
1=1 

1 1 ^ 

= - i:y DTDT-Y p^d(BeE[a*AE^QADQiaA + Oin-^''^). 
n n ^-^ 

e=i 

Plugging these terms in (j5.9p . we obtain: 

^, = 7 + ^. (- y a}TDTa, I ME^L + .f^] +ly p2djp\ + ^^^ + o{n-^l^) 
Vl^i \{l + 5dif l + diSj n^^'^ '") '^' 

using (pm)) and (|XTT|) . 



e=i 
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5.3. Step 3: Relation between (kj and O^j for k < j. The term (^^j can be written as 

Ckj = E[alEj{Qk - pqkkQkr]kr]kQk)D{Qk - pqkkQkr]kr]kQk)ak] 

= Okj - pikk'E[a*kKj{Qkm'nkQk)DQkak] ~ phk E[alEj{Qk)DQkr]k'nlQkak] 
+ p^PkkE[alEjiQkfikV*kQk)DQkVkVkQkak] + 0{n-'/^) 

= 9kj + Xi + X2 + X3 + 0{n'^'^) . 
Using similar arguments as those developed previously, we get: 
Xi = -ptkkakTkaknakMQk)DQkak\+0{n-^'^) = -pikkalTkakOk, + 0{n-^'^), 
X2 = -pikkalTkak9kj+0{n-'^^) . 
As k < j, 

X3 = p^Pkki4TkakfE[7jlE,iQk)DQkVk] + 0{,2-'/^), 
= P^Pkk {alTkakf [Okj + dk^j) + 0(n-i/2) . 
Using p.lOp and p.lip . we finally obtain: 

a, = p'tlk^ + dkSr Okj + dk (^^\ V-, + 0{n-''^) . (5.12) 

W + dkOj 

5.4. Step 4: A system of perturbed linear equations in {tpj^ipj). Proof of (|5.ip . 
Combining (|5.12p with (|5.7p . we obtain 

.2T 72 ^, _ 7 alTDTau 



P dktkk^kj — dk 



(l + dkS)^ 
— dkalTaidialTak dkalTDTak I m^ 2x2 ~i2 72 («fc^"fc)^ 



.i^Al + dk6)Hl + dt6Y {l + dk5Y ni^/ " ' 



fc.. , 7 ..A ^3 



{{l + dk5f{l + de5f {l + dkSf «^ {l + dkS) 



4 



V-j 



dk alTDTak 



(l+dkSr 
which implies that ipj ~ — J2k=i P'^'^kPkk^kj satisfies 

(1 - Fj)ifj - {Gj + FjMj) ijjj = Fj + 0{n-^^^) 



ipj+0{n-^^^) (5.13) 



where 



^ .^^ , alTDTak dk 

Fi = ^ '" 



J 



n ^ (1 



fi i^ + dkS)' 



^'^3 = lilp'^ud}, (5.14) 

£=1 
-, j j 

-EF- 



_ - ^ - y - dkdi \alTat\ 



e^k 



With these new notations, equation (|5.1ip is rewritten 

-7Vj + (1 - F, - tA/jOV-j = 7 + 0(n-i/2), 
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and wc end up with a system of two perturbed linear equations in {ipj, ipj): 

(1 - Fj)ipj - {Gj + FjMj) i!j = Fj + 0(n-i/2) 
-7^j + (1 - F, - 7M,)V, = -i + 0[n-^/^) ' 



(5.15) 



The determinant of this system is Aj = (1 — Fj)^ — ^Mj — 'jGj. The following lemma 
establishes the link between the A,'s and A„ as defined in Theorem 



Lemma 5.3. Recall the definition of An : 



1 



1- -TvD^TA{I + 5Dy^DA*TD^' 



P^ll ■ 



The determinants Aj decrease as j goes from 1 to n; moreover, A,i coincides with A„. 



Proof of Lemma 15.31 is postponed to Appendix IB.31 

Solving this system of equations and using the lemma in eonjunction with the fact 
liminf A„ > 0, established in Lemma 13.51 we obtain: 



1 

A~ 



F,(1-F,)+7G; 

7 



'] ■> 



where ||£j|| = 0{n ^/^). Replacing into (|5.13p . we obtain 

^^ 'l^' " = 2(F, -F,_i) + (G, -G,_i + 2M,(F, -F,-_i))V^, + 2(F,- -F,_i)(p, + ©(n-^/^) 



2(^, - ^,-i) ■ 



7(G,--G,-_i) + 27M,(F,-F,_i) 
A, 
, 2(F,-F,_i)(F,(l-F,)+7G,) 



+ 0(n-3/2) 



which leads to 



1 " 



j=i 



+2 fl. . 



^ y AFj - Fj-i){^ - F,) + i{M, - ilJ,_i) + 7(G,- - G,_i) ^ ^^^-i/2y 

3 = 1 J 

On the Other hand, Aj_i-Aj = 2(Fj-F,_i)(l-F,)+7(Mj-A/^_i)+7(Gj-Gj_i)+C'(?^-2)^ 
hence, due to Lemma 15.31 and to liminf A„ > 0. 



_. n n 



Aj-l - Aj 



+ 0(71-1/2) 



j=i 



i=i 



Elog(l + ^^^-^)+0(n-V^) 



A,-i 



^ log -^ + 0(n-i/2) ^ „ iog(A„) + 0(n-i/2) 



j=i 



A, 



which proves (15.11) . Lemma 14.31 is proven. 
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6. Proof of Theorem 12.21 (part III) 



In this section, we complete the proof of Theoreni l2.2l Proof of Lemma IT^ is very close to 
the proof of Lemma 14.31 we therefore only provide its main landmarks. We finally establish 
the main estimates over (0„). 

6.1. Elements of proof for Lemma 14.41 Proof of Lemma 14.41 relics on the following 
counterpart of Lemma 13.21 



Lemma 6.1. Assume that the setting of Lemma \3.'2\ holds true; and let E.t^ = d. Then for 
any p > 2, 

E\x^Mx - i9TrM|P < Kp ({E\xi\^ Tr MM*Y^^ +E\xi\^pTt{MM*)p/^ 



Proof. The result is obtained upon noticing that 

1 3 
x'^Mx = -^i'' {i'^x + x)* M (i'^S + x) 



A- 

fc=0 

and using Lemma 13.21 D 

Here are the main steps of the proof. Introducing the notations 

±^ = -TiE[{EjQ)DQD\ , 
C,^. = E[aliE,Q)DQak] , 
e^^ = E[aUEjQk)DQkak] , 

3 



- Y^ P^dkPkkikj : 



—J n 

k=l 

and adapting Lemma l5. 11 wc only need to prove that: 

Similar derivations as those performed in Steps 1-3 in Section [5] yield the perturbed system: 

1 -i97^. + (1-i?£j-7|z?|2Mj)iA. = 7 + 0(71-1/2) 
where 



p _ 1 Y^ alTDTok dk ^ ^ _ 1 y^ y^ dkdt {alTaif 

-' ^ ^h i^ + dkSr ' -' ^ n^^f^^(i + dkS)^l + d,S)^ 

e^k 

j 

'1 



^^1 = -izp^^ud 



n 
1=1 



The determinant of this system is: 
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By (|Xn|) . < 7 < 7; furthermore, \^\ < 1, |Fj | < F^, and \Gj\ < G.j. As a result, 
A ■ > Aj. Hence, by Lemma [5.31 the perturbation remains of order 0(n~^/^) after solving 
the system. Performing the same derivations as in Step 4 in Section [5l it can be established 
that A„ = A„. We finally end up with: 

1 " " A — A 

j=i j=i — ^ 

= -log(AJ+0(n-i/2), 
which is the desired result. 



6.2. Estimates over Qn- In order to conclude the proof of Theorem 12. 2| it remains to 
prove that < liminf„ 8„ < limsup,j 8„ < oo. 

Consider first the upper bound. By Lemma [3.5[ sup„(— logA„) < oo. As A„ > A„, 
log An is defined and sup„(— logA„) < oo. By Lemma 13.41 the cumulant term in the 
expression of 6„ is bounded, hence limsup„ 9„ < oo. 

We now prove that liminf 6„ > 0. To this end, write: 

j = l ^ ^J —3 ^ ^ ^=l j = l 

_^/ 7(G.--G.-i) , l^p7(G,-G,-i) \ 

U\ ^^ ^^ J 

I ^/' 2(F,-f,-i)(l-F,-) , 2Re(^(£,-£,_i)(l-^£,)) \ 
j=i \ ^ J / 

We prove in the sequel that Zi_„ > 0, Z2^n > 0, and that liminf„ Z^^n > 0. It has already 
been noticed that A^ > A^; moreover, it can be proven by direct computation that \Gj — 
Gj_il < Gj - Gj_i, hence Zi,„ > 0. As 



1-Fj -' -^1 |i-i^£j| 



this implies that A^- ^|1 - -dFj] < A^ ^(1 - £,). Noticing in addition that \Fj - £j_i| < 
i^j - Fj^i, we get Z2,„ > 0. The cumulant k = EI^Ynl"^ - 2 - |i?|2 satisfies k > -1 - |?9|2, 
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hence 

j=l \\ 3 / \ j / / j^i 



o2 



N , N 



j=i ■' k.e=i — J k,e=i 

k^e k^e 

2 ^ //I \ /l \\^ 2^ -^ 

j=l V V J / V — j / / i=i j=i .i=i 

As the term pj is Hnear in |?9p G [0, 1], Pj > min(Aj^(l - A^), AJ^ +-^7^ ^2). We have 
A,-A^- < ((1 - F,f - 7(M, + G,)) ((1 + F,)' + 7(A/, + G,)) , 

Hence A~^ + AJ^ - 2 > Aji + Aj - 2 = A7i(l - A^)^. As 1 - A^ > -fMj, we get 
Pj > -f'^M^, which imphcs that 

^3.«^^E^^.^E^?4 = 7^(E^(^-^-))^E^?4 

j^i i^i j^i i^i 

J — 1 i — 1 z— 1 



whose hminf is positive by Lemma 13.41 

The estimates over the variance are therefore estabhshed. This completes the proof of 
Theorem O 

7. Proposition 12.31 feiAsl: Main steps of the proof 

Proof of Proposition l2.3l -(i) can be found in [T31 Theorem 2]. Let us prove (ii). The same 
arguments as in the companion article [H] allow to write the bias term as: 

/•oo 

7V(EX„(p)-K(p))= / TY{T{-uj)-EQ{-Lj))duj, 
J p 

Recall that in the centered case where A = 0, T{—lu) and T{~uj) take the simple form 
r(-w) = [uj{In + S{-u)D)]-^ and f (-w) = [u{In + S{-u)D)]^\ which implies that 7 = 7 
and 7 = 7. We introduce the following intermediate quantities: 

a{-u) = -TrDEQ{-uj), (5(-w) = -TrDEQ{-uj), 

n n 

C{-uj)= (uj{In + &{-uj)D)y\ Ci^u;)= (cj(/„ + a(-cj)^))~\ 

From Theorem [331 n~^ Tr U{C - T) ^ and n'^ Trt/(C' - f) ^ for any sequences of 
deterministic matrices U and U with bounded spectral norms. 

The proof consists of two steps: 
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7.1. Step 1. Given w > 0, let 



where 



Rn{L0) 



PnH 



1 — a;^77 \n 



m' 



l-w2|?9|277 



i?„(w) 



TiiMf 



UJ"f- 



Tr{DTf 



^^7 



TtD^T^. 



The purpose of this step is to show that J |/3„(w)| d(aj) < oo and that 



iV(ET„(p)-K(p)) 



(3n{L^)d{Lu) 



^0 



(7.1) 



By inspecting the expression of /3„(aj), by using Lemmas 13.41 and 13.51 and by recalhng that 
1 — Lo'^j'y = A„ taken at z = —cu, we obtain after a small derivation that |/3„(aj)| < K/u'^ on 
[p, oo) where K does not depend on n nor on to. This proves the integrability of |/3„(aj)|. By 
taking up the poof of |211 Inequality (7.10)] with minor modifications, we also show that 



\TviT{-Lu)-EQ{-Lj))\< 



K 



hence, showing 



Tr(T(-cj)-EQ(-w))-/3(w) 



^0 



(7.2) 



and applying the Dominated Convergence Theorem leads to (17.11) . In order to show (|7.2[) . 
we start by writing for z = —lo 

Tr (T - EQ) = Tr (T - C) + Tr (C - EQ) . 
Using the decomposition Tr (T - C) = Tr C{C-^ -T-^)T = uj {a- 5] Tr DCT, we obtain 

(7.3) 

On the other hand, writing n{a - 5) = Tri:»(EQ - C) + TrL»(C - T) ^ TtD{'&Q - C) - 
ui{a — 5) Ti D^CT and similarly for n(a — 6), we obtain the system 



Tr(T-EQ) ^ujn[&-S) - Ti DCT + Tr{C - EQ) . 



1 ujn 



n{a — S) 
n{a — S) 



'TrD{EQ-C) 
TtD{EQ~C) 



(7.4) 



Consequently, in order to show (|7.2p . we need to look for approximations of TrU{EQ — C) 
and Tr UiEQ — C) for deterministic matrices U and U with bounded spectral norms: 



Lemma 7.1. Assume that the setting of Provosition \E73\ holds true. Fix z = — oj < and let 
iUn)n (resp. {Un)n) be a sequence of N x N (resp. n x n) diagonal deterministic matrices 
such that sup„max(||[/„||, llC^nll) < oo. Then, 



^^7 



9 ~ 

w 7 



1 



TrC/„(C-E0) + K=^TrC/i?2j.3^|^|2^ ^1^^^- 

n 1 — a; |u|^77 n 



Tr UD^T 



2rp3 



^0, 



9 



9 

a;^7 



1 



TTUn{C-EQ) + K^TTUD^T^ + \d\''- ^—^ . 

n 1 — w |w| 77 n 



- Tr C/£)^T 



2rTi3 



^0. 



(7.5) 
(7.6) 
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Recalling that n"^ Tr U{C-T) -^ and taking U = D^T, wc have n"! TvD^CT--/ -^ 0. 
Similarly, n^^ Ti D^CT — •y ^ 0. Solving system (|7.4p and using this lemma with U = D 
and U = D, we obtain 



n{a — 5) = 



1 



1 — u;^77 

K 



-Ljj Tr D{EQ -C)+ Tr D{EQ - C)) 






1 — a;277 \ n 



■ Tr(i:)T)^ TiiDTY 



'^'^ Tr(M)3 _ ^ Tr(OT)= 



(1 — a;277)(l — a;^|t?P77) y n " ' n 

where e,e' -^ 0. Using Lemma \7A] again in ()7.3p with U ~ I, wc obtain (j7.2 
The remainder of this paragraph is devoted to the proof of Lemma 17.11 
Recall the following notations: 

1 .,..„,. d 



h,{-u:) = 



and e_,(— w) = ■q*Qj{—Lo)ri.j TrZ?Qj(— w) 



uo[1+'^TtDQj{-lo)^ 
Starting with 

TrC/(EQ-C) =TrE[C/C(C-^ -Q"^)Q] = - TrE[t/CI]I]*Q] + u;5TrE[C/Ci:'Q] 
and using (|3^ and (|3T7)) . wc obtain Tr U (EQ - C) = Zi + ^2 + ^3 where 



n 

^e[. 



Zi = _^E |cj^6; cj Tj*QjUC7jj 



^2 = 



71 



j=i 



Zg = cj 5 E Tr C/Ci:»Q ^ E bjdj Tr Dg^ t/C . 



In the remainder, we omit the study of the negligible terms to focus on the deterministic 
equivalent formulas; in this spirit, we shall denote by e a negligible term whose value might 
change from line to line. 



The term Zi is 



Zi =^E 



uj'bUj [rj*QjUC?y 



~ TtDQMC 



Using Identity (|X^ with M ^Qj, P ^ QjUC and m = 0, we obtain: 



77 ^-^^ 



J = i 



^2^2 j -3. Tr QjDQjUCD + -LLjs ^r QjDCUQjD 



N 

+-Y,d'jdUQMQjUC]. 



■ e. 
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It is not difficult to check that 
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Z^, 



j=i 



uj%-^. d-j ^^ e^ 



+ £. 



Turning to Z^, we have 



n 

Z-i = - ^ E [djEgjj Tr UCDQ - dj bj Tr UCDQj 



j=i 

n 



j=i 



Eqjj (Tr UCDQ, - uq,, Tr UCDQjr]j'n*Qj) - bj Tr UCDQj 

2 n 



j=i i=i 



bjifjQjUCDQj-nj 



Replacing bj by g^j + ujbjej — cj qjjbjej, we have 



E 
Since 



(Egjj - 6j) Tr UCDQj = E [(E^jj - g^-^) Tr UCDQj] + E to^qjfb'^e] Tr C/CDQ^- 






VjQjVj --E(7?*Qj7?j) 
uj{l + rj*Q,7j,)(l+E{rf,Q,rj,)) 



wc have E((7jj — Kqjj)'^ = ©(l/ri). Hence 

E [{Eqjj - q^j)Tr UCDQj] = E [{Eqjj - <?jj)(Tr UCDQj - E Tr UCDQ^)] = 0{n-^'^) 

E 



by Theorem [331- (P. It follows that E (Eg^j - bj) Tr UCDQj 
hence 



w^fo^gS Tr UCDQj 



^2 + ^3 = E^ 



i=i 



w^fo^d^- TyQjDQjUCD 



Taking the sum Zi + Z2 + ^3, the terms that do not depend on •& nor on k cancel out, and 
we are left with 

Tr [/(EQ - C) = \dfu?^-E [Tr QDCUQD] + kuj^^- Tr C/D^j^^ ^ g_ 

n n 

where we relied on the usual approximations for the diagonal entries of the resolvent (see 
Lemma l4.ip to obtain the term in k. We now briefly characterize the asymptotic behavior 
of n-^ TiEQDCUQD. Starting with Q = T + loSTDQ - TY.11*Q, we have 

- TIEQDCUQD = - TiETDCUQD + — TrETDQDCUQD - - Ti-ETJ:j:*QDCUQD, 
n n n n 
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and 



1 - 1 " 

- TrETY.Y.*QDCUQD = '^EujqjjT]*QjDCUQDTrij 

" j=i 
1 " 

1 " 

i=i 
TtETDQDCUQD + |i9| V77- 



n n 



n ■ 



^^ r^..Tr.rr.T^r^T^r^TTF.T^ . LQ|2 2 _~TrEQi:>C[/Qi:» 



We therefore get 



■Tr EQDCUQD = ," . ,, .|2.,--, + ^ 



Tr t/D^r^ 
n "^ "^ 1 — a;2|i?P77 

and Convergence (j7.5p of lemma lT.ll is shown. Convergence (|7.6p is proven similarly. Lemma 
7. H is proven, and Step 1 of the proof of Proposition [231- (ii) is established. 



7.2. Step 2. The purpose of this step is to show that 

^^^'^ " 2 d^ (w27(-w)7(-cj)) . 

Plugging into the expression of /3„(a;), it is straightforward to show that J /3„(a;)d(a;) 
coincides with S„ given by (|2.5p . 



Recall that 

ii'(w) = ^ ^ '- ^ ^ ^ OJ^^ = R1+R2+B 

1 — aj^77 n n 1 — w 77 n n ?i 

Our method is similar to [lH §V.B]. We start by showing that the derivatives of 7(— w) and 
j(—uj) that wc denote respectively as 7' and 7' are 



., _ d7(-a;) _ 2^ 2a; Tr(i:»r)3 TrDT^ 

dw cj 1 — a;-^77 ?i n 

, d7(-a;) 2 2w Tr ( DTf Ti DT^ 

7 = — ^ = 7+:; 2 



(7.7) 



dui u) 1 — uj jj n 71 

We have 

l=-±d^^^( ' U-^-2..'^(^^ 

where we put S' = dS{—oj)/duj. This derivative can be expressed as 

"h dc^ v^(i+d.<5(-^))y 



n 

1 = 1 v-\- 

,-1; 



where S' = dS(—uj)/duj. Similarly, S' = — cj ^S — uj^yS' . Combining the two equations, we 
obtain 

1 — uj-^jj 
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Since T = [uj{I + 6D)]~^ and f = [uj{I + SD)]-^, we have 

T = uj-^In - 6DT, f = uj-^In - 5bf. (7.10) 

This leads to 

-TyDT^ ^-TtDT{{uj-^I -~5DT)^uj-^6--^~5, imd-TTDf^=uj-^~5-^5. (7.11) 
n n n 

Combining with (|7.9p and (|7.8p . we obtain the first equation of (|7.7p . the second being 
obtained similarly. Using the first equation, the term Ri can be expressed as 

i?i = - (a;^77' + 2^77) . 

Turning to R2, we have 

a;4^2 Tr(DT)3 Tr DT{uj-^I - SDT) 



i?2 



1 — w^77 n n 

uj^S^"^ Tr(DT)3 ^45772 Tr(i:>T)3 



1 — a;277 n 1 — u'^j'y n 

(a) uj^^ TT{DT)^TTDf^ ^~Tr{DT)^ 

1 — uj^"fj n n n 

(") 1 / 2 ,~^. ~N 2-; Tr(JJT)3 

= — (w 77 + ZW77I — uj 70 

2 ^ ' n 

where (a) is due to jS = uj^-^d — n^^ TtDT^, see (|7.1ip . and (6) is due to (|7.7p . Considering 
i?3, we have by (fTTOl) . 

2_^Tr(i:>r)3 2^TrD2y3 ^^Tr D^T^(T + SDT) 

—OJ 70 a; 7 = — a; 7 = — W77. 

n n n 

We therefore have i?(w) = 0.5 (aj^7'7 + ^^77' + 2aj77) ~ 0.5(aj^77)'. Proposition 
proven. 



Appendix A. Proofs for Section [3] 

A.l. Proofs of Eq. ([XTU]) and Eq. ((XTT1) . Proof of Eq. ((XTU)) mainly relies on matrix 
identity p.2p and on the following identity for the inverse of a partitioned matrix (see for 
instance [231 Section 0.7.3]): 



If A 



an Ml 

Ml Ml 



then (A-i)^^-(an-Ai2A22iA2i) ' . (A.l) 



To lighten the computations, let us introduce the following notations: 

In order to express a diagonal element of T, say in (without loss of generality), let us 
first write: 

-z{\ + 5di) + a\Tai a^TAi 

A\Xax -zI-^+AlIAi 



r = 
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Hence, according to (|A.1[) 
1 



<i 



= -z{l + Sdi) + alIai-alIAi -zl'^ + AlIAi A\Xax 



(a) 



(b) 



(6) 



-z(l + Sdi) + a[Tai — a[XAi 



-I+-IA*TiAiI 

z z 



Allai 



r(l + 5di) + allai + -all {Tf^ + zJ-^) lai 

1 
— ( 

z 

-z{\ + 5di) + 2a\Tai H — a[TT{^ Tai 

1 
— ( 

z 



-allAiIAl [In + zT{I^^] lai 

1 
— ( 

z 



all [T^^ + zl-i] [In + zTiI-^] Ta^ 

= — z(l + (5(ii) — za^Tiai , 
where (a) follows from (|3.2p . (fe) from equalities 

TiAiXAl =In + zTiI'^ and AiIAl = Tf^ + zl'^ 
which follow from the mere definition of 7i . Finally, p.lOp is established. 

Let us now turn to the proof of (|3.1ip . Notice first that T can be expressed as 



T 



-z{In + ~5D) + Ai(/„_i + 5b^)-^Al 



aia^ 
I + 5di 



Applying (|3.2p readily yields: 

T = 7i - Tifli ( 1 + 5di + aJTifli j alTi ■ 
It remains to multiply by a* (left), h (right) and to use p.lOp to establish p.lip . 



A. 2. Proof of Inequality (|3.15p . We provide here some elements to establish that E|ej | 
0{n^^/'^). Recall the definition p.ip of Cj and write: 



EleJP < A'<^E 



y*jQ3V3 - tT'-^^. 



+ E |a*(3jj/j|^ +E \y*Qja.j\^ 



The first term of the r.h.s. can be directly estimated with the help of Lemma [3.21 The two 
remaining terms are similar and can be estimated in the following way: 



E|a*0,-y/ = ¥.{y*Q*aja*Q, 



iVj) 



vP/2 



< K 



dl 



y*Q*aja*Qjyj TTQ*aja*Q 



p/2 



— TTQ*aja*Qj 



p/2 



The first term of the r.h.s. can be handled with the help of Lemma l3.2l (notice that Q*aja*Qj 
is of rank one and has a bounded spectral norm) , and the second term is directly of the right 
order. 
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A. 3. Proof of Theorem 13.31 Items (HI)-® of Theorem [23] are shown in [32- Let us show 
Theorem 13. 31 - (PI- Denote by {Sj,Sj) the solution of System (|1.2p when A and D are replaced 
with Aj and Dj respectively. Let Tj and Tj be the matrices associated to {6j,Sj) as in 
Eq. dO]). Then E\u*{Qj - Tj)v\'^p < Kp-n-P by Item ^, and we only need to show that 

\u*{Tj - TjOvl < K/Vn- Wc have 

\5~6,\^^\TrD{T-T,)\ 

< - \TtED{T - 0)1 + - \Ti-ED{Q - Q,)\ + - \TtED{Qj - T,)\ = 0{n-^) 
n n n 



by Item © and Lemma [XT] Moreover, 



\S-Sj\ < - TrED{f-Q) 



E{TtDQ-Ti-DjQj) 



TrED,iQ,^f, 



In order to deal with the middle term at the r.h.s., assume without generality loss that j = 1. 
Using the identity in |23[ Section 0.7.3] for the inverse of a partitioned matrix, we obtain 



Q 



gii ^ X 

X Qi+qiiQiT,lriir]lJ:iQi 



hence E{Tt DQ - TvDiQi) = 0(1), which shows that \6 - S-j] ^ 0{n-^). We now have 

u*{T,~T,)v^u*TATi'-T-')T,v 

= u*Tj (p{5j - 6)D + {S- Sj)Aj{I + 5jbj)-^bj{I + 5b j)-^ A*) T^v ^ 0{n-^) 

which proves Item ([4]). In order to prove Item ([5]), we develop Tr U{Q — EQ) as a sum of 
martingale differences: 



Tr U{Q - EQ) = ^(E^ - Ej_i) Tr UQ 



j=i 



= ^(E, - E,_i) Tr U{Q - Q,) = - ^(E, - E,^^){pq,,f^*Q,UQ,j^,) 

by ([31]), hence E\TyU{Q -EQ)\^ = E"=iE|(Ej -Ej^i){pqjjr^*QjUQjT]j)\^ . We now use 
([XT]) . We have 



E 



{E,-E,.,){ph,r,*Q,UQ,ri,] 



-_, ( pbj [ VjQjUQjVj - dj - a*QjUQja.j 



by Lemma [3.21 and furthermore. 



E 



^0{n-') 



{E, - E,^^){p'q,fb,e,i^*Q,UQ,T^j) ' < K (Eef E\f^* Q,UQ,ii,\^Y'^ - 0{n~^) 



by Lemma [32] and ([XT5]) . This shows ThlXB([5]). 



36 HACHEM ET AL. 

A. 4. Proof of Lemma 13.41 The two first upper bounds are easy to obtain, given that (5„ 
and Sn are Stieltjes transforms of nonnegative measures with respective total mass n~^ Tr D 
and n~^TiD. Now Ti DT"^ < dmax TrT^ by Inequahty (|3TT4l) . which in turn is smaller 
than N d-aii^^p"'^ , hence the third upper bound, and the other upper bounds can be proven 
similarly. Let us now prove the first lower bound. 

Tr£) = Tt{t^-dt^t-^) < Tr(i:»r) x ||r-i|| , 



< Tt{DT) X (^p(l + 5„d„,ax) + aLxll (^ + SnD) 

(b) f 

< Tt{DT) X i^p + dinaxdmax + afnax 

where (a) follows from (|3.14p and (b) from the upper bound on (5„. This readily yields 
(5„'s lower bound and (5„'s lower bound which can be proven similarly. Writing Tr_D < 
(Tri:)T2)||r-i||2, we obtain the lower bounds on n''^ Ti DT"^ and n'^ Tr Df^ similarly. The 
lower bound for 7„ follows from the same ideas: 

1 \ ^ 1 1 

< —Tr{TiD^Ti)x\\T-^\\ = —Ti{Ti DT^T'^T^ DT^) x \\T-^\\ , 

< —Tr{TDTD) x \\T-^\\^ , 

and one readily obtains 7„'s lower bound (and similarly 7„'s lower bound) using Assumption 
A-[3]and the upper estimate previously obtained for ||T^^||. 

The two last series of inequalities related to n^^ J2i=i '^f^u ^'^'^ ^~^ S?=i '^?'^?7" '^^^ ^^ 
proven with similar arguments (lower bounds are in fact easier to obtain as one can directly 
get lower bounds for ta and tjj - using (j3.10p for instance). 

A.5. Proof of Lemma inHJ From ([01), TA{I + 6D)-^A* = I - pT{I + SD). Moreover, 
(/ + 6D)-^D = 5-^1 - S-^{I + 5D)-\ Hence 

-Tr D'^/'^TA{I + SDy'^DA*TDi < -^Tr DTA{I + 6 Dy^A*T 
n no 

= I- ^Tr DT^-p--f (A.2) 

nd 

which proves the first assertion with the help of the results of Lemma 13.41 Similarly, 

- Tr b^/^f A* {I +~5DY^ DAT m < 1 - -^Tr DT^ - p^j (A.3) 

n n6 d 

We now show that the left hand sides (l.h.s.) of (jA.2p and (jA.3p arc equal. Using the well 
known matrix identity (/ + UV^^U = U{I + VU)-^, 

TA{I + 6D)-^ = p-\l + SD)-^ (l + p-^A{I + SD)-^A*{I + SD)-^) A{I + SD)-^ 

= p-\l + ~5D)-^A{I + 5b)-^ (/ + p-^A*{I + SD)-^A{I + SD)-^^ 



{I + SD)-^AT. 
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Plugging this identity in the Lh.s. of (jA.2[) . and identifying with the Lh.s. of (|A.3[) . we obtain 
the result. As a consequence, we have 

2 / 



1 - -TtD^/^TA(I + SD)-^DA*TD^] > i ^ Tt DT^ + p--/] { -^ Tv Df- + p-=^ 
n J ynd 6 J \nS d 

>P^11+—, Tr DT"^ -^ Tr bf^ 
no nS 



which is the second assertion. By Lemma [3.41 this leads to liminf A„ > 0. Lemma [3.51 is 
proven. 

Appendix B. Additional proofs for Section [5] 

B.l. Proof of Lemma l5.ll Let us show that max^ var(a*Ej(5£'Ej(3a) = 0(?i^^). We have 

j 
a*E^QDEjQa - Ea*EjQDEjQa = ^{E^ - E,^i){a*E.iQDEjQa) 

4 = 1 

3 



^(E, - E,_i) D^^%{Q, - pqHQ;mv:Qr)a 

i=l 

3 

^(E, -E,_i) -2pRc{a*iE,Q,)D{E,quQ^7]^7^*Q,)a) 



i=l 



+ \\Ej{pqu7j*Q,aD^^^Q,n,)\\ 



A 



2Re{X) + Z, (B.l) 

and the variance of a*EjQDEjQa is the sum of the variances of these martingale increments. 
Consider the term X. Recalling that qu = bi — pqubiei, 

3 3 

X = -pY^{E, -E,^i)ikr]*Q,aa*{E,Qi)DQ,7^,) + p^J2{E, -E,^i)ib,que,rj*Q,aa*{E,Q,)DQ,rj,) 

= X\ + Xi . 
Let Mi ~ Qiaa* {EjQi)DQi. The term Xi satisfies 



E|Xi|2=p2 J^E 



i=i 



ib, V*M,y, - -^ TvDM, + V*M,a, + a*M,y, 



(B.2) 



Since Mi is a rank one matrix, X]i=i ^\yi^'hyi — di Tr DMi/n\'^ < K/n. Moreover, 



7 7 ^ J 

Y^E\y*M,a,\^ = i ^ J.E (a*Q,DQ,a \a*{EjQ,)DQ,a,\^'^ < :^ ^E |a*(E,Q,)^a. 

i— 1 2—1 2 — 1 

The summand at the r.h.s. of the inequahty satisfies: 

\a*iE^Q,)DQ,a,f < 4 {\a*{E^Q)DQa,\'' + |a*(E,(Q, - Q))D{Q, - Q)a,f + 

\a*{EjQ)D{Q, - Q)a,f + |a*(E,(Q, - Q))DQa^f 



A 



4(W,,i + W,,2 + W,^3 + W,a)- 
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Recalling that Ai-j ~ [ai, • • • , Uj], we have 



^M^,,i = a*{EjQ)DQAi.,,Al^QD{E,Q)a < K 



Recalling p.5p and p.6p . and writing ^^ = 1 + r}*Qir]i, wc have: 



— X a Ej Hi Q7],T], Q) D- — — 

1 - ViQm 1 - vtQm 



w,,, < r'JZ X «*% (e. QrnvIQ) D ,'':^ D E, (e, QimlQ) a 



As 11(1 - rl*^Qv^y^Qv^v:Q\\ = \\Q - Q^\\ < K and ligsll < K, we have ELi ^^^^2 < 
Y^l=i 1^ [|fl*Q^iPlCjP] ■ Writing S,i = [phi)^^ + a, and noticing that [phi)^^ is bounded, we 
obtain: 



3 



^EW,,2 < 2Ea*Q^i..jAmg{{phiy\...,{phj)-^)i:ifia + A'^E|e,p < K. 

i=l 4=1 

The terms W^^a and Wi^4 can be handled by similar derivations. 

We get that Yft=i^V* ^^a^]"^ < ^/n. The terms a*M^y^ on the right hand side of ^^ 

satisfy Y^^=l E |a*Mj2/j|^ < Kn-^ Y.i=i ^a*Q^a\^ < K/n, which proves that EjXip < K/n. 

We now consider X2, which satisfies E|X2p < 2p''^^^j Elbiqueirj* MiTji]'^ . We have 



'jail 



i=l i=l 

< ^^E|a*A/,a,|2<:|^^E|a*Q,a|2<:|, 

4=1 i=l 

where E^') = E[-|2/i, . . . , y^.i, y^+i, . . . ,y„]. Moreover, 

J I 2 -^ 7,' 

y E 6,g,,e,2/*M,a, < A'V (E|e,|4)i/2(E|y*M,a,|4)i/2 < _ 
^ — ' I ^ — ' n 

1=1 i=l 

and similarly for the terms in a*Miyi and in y*Miyi. We get that E|X2p = 0{n~^). We 
now turn to the term Z of equation (|B.ip . To control the variance of Z, we only need to 
control the variances of the terms: 

i 
Z\ = ^(E! -E,_i){Ejqua*Qiyiri*Qi)D{EjquQii-iia*Qia), 

i=\ 

J 

Z2 = ^(E, -E,_i)i|E,fey*Q,a-Di/2g^^^^)|j2^ 

i=l 

i 
Z3 = Y.^E,-E,_^)\\E,{qua*Q^aD^/^'Q,^{)\\\ 
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The first term satisfies 

i 
E|Zip < 2Y,K\i^JQ^^a*Q^y^rl*Qi)DiE,quQ^v^a*Q^ 
1=1 
j 



ia)l^ 



|2 

ia\ 



< 2 ^ E I iEXQry.v:Qr)DQ.n,a*Q, 

i=l 

= 2^E [Kg.apEW \{E,a*Q,y,rf,Q,)DQ,T], 



K 



1=1 



< -^E|a*g,ap = O(n-i), 

i=l 

where the second inequality conies from E\Ej{X)Ej{Y)\'^ = E\Ej{XEj{Y))\'^ < E\XEj{Y)\'^. 
The terms Z2 and Z3 can be handled similarly; details are omitted. The result is E|Zp < 
K/n. 

Hence, vai {a*{EjQ)'^a) = 0(71-1). j,^^ estimate var (Tr(EjQ)i:)(EjQ)) = 0(1) can be 
established similarly. 

B.2. Proof of Lemma 15.21 Recalling the expression (|3.10p of tu, we notice that (1 — 
piuaYTgai) = piuil + dgS) is bounded below. It follows from Theorem 13. 3K [5|) that 

■•^-^ aiU*Tai,E[a*^Qu\ -^-^ aeu*Taea'^Tu -i/2\ 

^ I - piualTtai, j-[ piu{l + deS) 

Moreover, 

yaeu Tae j — -— E [agQiu] ^ ^atu Ta^E agQiu = — -— 1 

^ \l- ptuagTiai J ^ L \l- ptuafliai 



-2_^aeu Tat ~ — ;-= = £1 + S2 

^ 1 - pteea^Teae 

We have ei = X^Li ^e u*TaeE [a*f,Qiu£,e] where E\^e\P < Kn-P/^ for p > 2. It follows that 

kil < (ELi«?l"*^«^l'IEe|) (ELiIE|alQf"|') < A7\/^ by Theorem ESdll). By 
writing 

E,^ E[{pqua*^Qir]i~E[pqualQir]i]) y'^Qiu] 
atu 1 at J — — 
^^^ 1 - ptuafliat 

and proceeding similarly to ei, we obtain |e2| ^ K/ ^Jn^ which completes the proof of Lemma 



B.3. Proof of Lemmaim The F^ increase to F„ = n^i Tr£)i/2y^(l+^£))-2£)^*y£)i/2 ^ 
1 by Lemma [3.51 As 7 > and Mj and Gj are increasing, A^- is decreasing. In order to 
show that A„ = A„, we only need to show that i\/„ + Gn = p^l- We have 

G„ = - TvDil + SD)-^A*TAD{I + SD)-^A*TA - -Y ( A<£^] 
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Recall from ([XTU)) and (piT|) that (1 + Sdky^alTak = (1 + Sdh)^^ - pi^k- Hence 



1 " 

-E 



dka^Tak \ _ 1 ^^ 2 72r2 1 V^ pd^ikk 1 v^ '^k^V^^k 



n— V(l + J4)2y n^^ n^^^l + 5dk) n^^(^l + 5dkf 



which results in 

Af„ + G„ = -TTDfD{I + SD)-^ - - Tr D^ {I + SD)-^A*T A 
n n 

+ - Tr D{I + dD)-^A*TAD{I + 5D)-^A*TA. 
n 

Now, one can check with the help of p.l2p that p^7 = p^ti^^TyDTDT is equal to the 
r.h.s. of this equation. Lemma 15.31 is proven. 
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